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Abstract — Wc study the maximum out forests of a (weighted) digraph and the matrix of maxi- 
mum out forests. A maximum out forest of a digraph _r is a spanning subgraph of F that consists 
of disjoint diverging trees and has the maximum possible number of arcs. If a digraph contains 
out arborescences, then maximum out forests coincide with them. We consider Markov chains 
related to a weighted digraph and prove that the matrix of Cesaro hmiting probabiHties of such 
a chain coincides with the normalized matrix of maximum out forests. This provides an inter- 
pretation for the matrix of Cesaro limiting probabilities of an arbitrary stationary finite Markov 
chain in terms of the weight of maximum out forests. We discuss the applications of the matrix 
of maximum out forests and its transposition, the matrix of limiting accessibilities of a digraph, 
to the problems of preference aggregation, measuring the vertex proximity, and uncovering the 
structure of a digraph. 

1. INTRODUCTION 

The concept of maximum out forest of a digraph directly generalizes the notion of spanning 
diverging tree (out arborescence) , which is one of the central notions in the theory of directed graphs. 
If spanning diverging trees of a digraph exist, then they coincide with maximum out forests; otherwise 
maximum out forests share their major properties. We study these properties in this paper, which 
has the following structure. After the main notation, in Sections 3 and 4 we study the properties of 
spanning diverging forests, in Section 5 we give a block algorithm for their construction. Section 6 
presents matrix- forest theorems, and in Section 7 we study the matrix of maximum out forests. The 
main result of Section 8 states that the normalized matrix of maximum out forests of a (weighted) 
digraph F coincides with the matrix of Cesaro limiting transition probabilities of any Markov chain 
related to F. In Section 9, the total weight of maximum out forests that connect two vertices is 
considered as a measure of vertex accessibility. Sections 10 and 11 deal with the applications of the 
matrix of maximum out forests in the contexts of scoring based on paired comparisons and detecting 
the structure of digraphs. 

2. NOTATION 
2.1. General terms 

In the terminology, we mainly follow [1]. Suppose that -T is a weighted digraph without loops, 
V{F) = {1, . . . , n} (n > 1) is its set of vertices, and E{F) its set of arcs. The weights of all arcs are 
supposed to be strictly positive. A subgraph'^ of a digraph F is a digraph whose vertices and arcs 
respectively belong to the sets of vertices and arcs of F. A spanning subgraph of i"' is a subgraph 

^ This work was supported by the European Community under Grant lNTAS-96-106. 

^ In the literature, (see, e.g., [2]) this object is sometimes called a part of F, whereas a subgraph F' of digraph 
F is defined as a part whose vertex set V{F') is a subset of V{F), whereas the arc set contains all the arcs of 
E{F) that have both incident vertices belonging to V{F'). Such a subgraph F' of digraph F will be called 
here a restriction of F to V{F'). 
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of r with vertex set V{r). The indegree id{w) of vertex w is the number of arcs that come in w. 
A vertex w will be called undominated if id(f/;)=0 and dominated if id{w) > 1. A vertex w is isolated 
in r r does not contain arcs incident to w. 

A route in a digraph is an alternating sequence of vertices and arcs wo,ei, wi, . . . ,ek,Wk with every 
arc Cj being {wi-ijWi). A path in a digraph is a route all whose vertices are different. A circuit is a 
route with Wq = w^, the other vertices being distinct and different from wq. A vertex w is reachable 
from a vertex z in _r if w = z or F contains a path from z to w. A semApath is an alternating 
sequence of distinct vertices and arcs, wq, ei,wi, . . . , e^, w^, where every arc is either {wi-i,Wi) or 
{wi,Wi-i). Semicircuit is defined in the same way. 

Let E = {sij) be the matrix of arc weights. Its entry equals zero if and only if there is no arc 
from vertex i to vertex j in F. If F' is a subgraph of F, then the weight of F\ s{F'), is the product 
of the weights of all its arcs; if F' contains vertices, but docs not contain arcs, then e{F') = 1. The 
weight of a nonempty set of digraphs Q is defined as follows: 

e{g) = Y: em 
Heg 

the weight of the empty set is 0. 

The Kirchhoff matrix [3] of a weighted digraph F is the n x n-matrix L 
elements £j ■ = —£ji when j i and = — J2 ^iki hj = ^i ■ ■ ■ ^f^- 

2.2. The structure of a digraph 

A vertex basis of a digraph F is any minimal (by inclusion) collection of vertices of F from which 
all its vertices arc reachable. The requirement of minimality can be equivalently replaced with that 
of mutual unrcachability of all vertices in the collection. 

A digraph is called strongly connected (or strong) if all its vertices are mutually reachable, uni- 
laterally connected if for any two its vertices at least one of them is reachable from the other, and 
weakly connected if any two different vertices are connected by a semipath. 

The restriction of F to any equivalence class of the vertex mutual reachability relation is called 
a strong component, or a bicomponent, or an oriented leaf of F. Weak components of F are defined 
similarly on the base of the vertex connectedness by semipaths. The unilateral reachability rela- 
tion can be intransitive, so it is not generally an equivalence relation. Nevertheless, maximal (by 
the inclusion of vertex sets) unilaterally connected subgraphs of F are sometimes called unilateral 
components of F. As distinct from strong and weak components, they may overlap. 

Suppose that Fi, . . . ,Fr are all the strong components of F. The condensation (or factorgraph, or 
leaf composition, or Hertz graph) F* of digraph F is the digraph with vertex set {Fi, . . . ,Fr} where 
an arc {Fi,Fj) belongs to E{F*) iff E{F) contains at least one arc from a vertex of Fi to a vertex 
of Fj. The condensation of any digraph F contains no circuits. 

If a digraph does not contain circuits, then its vertex basis is obviously unique and coincides with 
the set of all undominated vertices [1,2]. That is why the strong components of F that correspond 
to undominated vertices of F* are sometimes called the basis bicomponents of F [2]. In this paper, 
the term undominated knot of F will stand for the set of vertices of any basis bicomponent of F: 

Definition 1. A nonempty subset of vertices K C V{F) of digraph F is an undominated knot 
in F if all the vertices that belong to K are mutually reachable and there are no arcs {wj,Wi) with 
Wj G V{F) \ K and Wi G K. 

An extreme case of undominated knot is a singleton consisting of an undominated vertex (if F 
contains such vertices). The opposite extreme case is the whole vertex set of a strong digraph. 
The following statement [1,2] characterizes all the vertex bases of a digraph. 



= L{F) = {£,.) with 
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Proposition 1. A set W C V{r) is a vertex basis of F if and only if W contains exactly one 
vertex from every undominated knot of F and no other vertices. 

Schwartz [4] refers to the undominated knots of a digraph as minimum P -undominated sets. He 
formulates the Generahzed Optimal Choice Axiom (GOCHA). If a preference relation (digraph) 
defined on a finite set of alternatives is given, then the choice according to GOCHA is the union of 
minimum P-undominated sets of this digraph.^ This choice is interpreted as the set of "best" (in 
terms of GOCHA) alternatives. A review of choice rules of this kind can be found in [5]. 

2. 3. Diverging forests of a digraph 

A diverging tree is a digraph without semicircuits that has a vertex (called the roof) from which 
every its vertex is reachable. It is easy to see that the root is unique and its indegree is zero, the 
indegrees of all other vertices being one. A diverging tree is said to diverge from its root. A diverging 
forest is a digraph without circuits such that id(w;) < 1 for every its vertex w. 

Let F be a diverging forest. By indicating the vertices w m. F such that id('u;) = (these are 
called the roots of F) and the subsets of vertices reachable from each root, we obtain a partition 
{Vi(i^), . . . ,V.^i {F)} of the vertex set V{F) such that there exists a semipath in F between w G Vi{F) 
and z G Vj{F) if and only if i = j. Thus, the restriction of F to every subset Vi{F), i = 1, . . . , u', is 
a weak component of F. It is easily seen that every component of a diverging forest is a diverging 
tree. 

For a fixed digraph F, consider spanning diverging forests F oi F (such subgraphs do obviously 
exist for every digraph). 

Definition 2. A spanning diverging forest F of a digraph F is called a maximum out forest of F 
if F has no spanning diverging forest with a greater number of arcs than in F. 

Obviously, every maximum out forest of F has the minimum possible number of roots; this number 
will be called the forest dimension^ of the digraph and denoted by v. The number of arcs in any 
maximum out forest is obviously n — v. 

Let us emphasize that the property to be a maximum out fores is more stringent than the maxi- 
mality with respect to the inclusion of arc sets. This point is illustrated in the next section. 

By J^{F) = !F and J^k (-^) = Tk we will denote the sets of all spanning diverging forests of F and 
the set of all spanning diverging forests of F with k arcs, respectively; T^^^ will designate the set of 
all spanning diverging forests with k arcs where j belongs to a tree diverging from i. 

3. SIMPLE PROPERTIES OF DIVERGING FORESTS 

Lemma 1. Let F be a diverging forest. 1. If a digraph F' is obtained from F by the removal of an 
arc, then F' is a diverging forest too. 2. Suppose that digraph F' is obtained from F by the addition 
of some arc {z, w). In this case, F' is a diverging forest if and only if w is undominated in F and z 
is unreachable from w. 

The properties that make up Lemma 1 are obvious; we will use them in the proofs of Lemma 2 
and other statements without explicit references. The proofs are given in the Appendix. 

Lemma 2. If w is a dominated vertex of F, then for any k G {1, . . . , n — v}, the set J^k contains 

a spanning diverging forest F such that w is dominated in F. 

^ This union is also called the top cycle and the strong basis of the digraph. 

^ This name recalls ' W-bases" , the term Fiedler and Sedlacek [8] used for spanning diverging forests. 
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The stronger statement saying that for every k and every arc {z,w) G E{r), there exists a forest 
in J^k that contains {z,w), is generally wrong. Indeed, consider the digraph shown in Fig. la. The 
forest dimension of this digraph is one, and the unique maximum out forest F (which is a diverging 
tree) is shown in Fig. lb. Arc (4, 2) is not in F. This demonstrates that for some spanning diverging 
forests F', there is no maximum out forest F such that E{F') C E{F). For instance, the arc sets of 
the spanning diverging forests in Fig. Ic - le are not contained in E{F). 

Thus, a maximal (with respect to the inclusion of arc sets) out forest can be not maximum (see, 
e.g.. Fig. lc,d). This implies, in particular, that the arc sets of spanning diverging forests of a digraph 
cannot be considered as the independent sets of a matroid. 




Proposition 2. 1. Any undominated vertex of a digraph is the root in every spanning diverging 
forest. 2. // a digraph does not contain circuits, then no dominated vertex can be the root in a 
maximum out forest. 

Lemma 3. 1. The weights siJ^l~**) of the sets J^l~*^ are the same for all undominated vertices t 
of F and are equal to e{Tk)- 2. For any k G {1, . . . , n — v}, s{j^l~^^) > ^{J-^^^) whenever t is an 
undominated vertex in F and w is a dominated vertex. 

In the following statements, i,j, and k are arbitrary vertices of F. 

Lemma 4. // there exists a path from i to j in F, and there is no path from i to j in a maximum 
out forest F of F, then for some k ^ i, F contains the arc {k, j) or i is reachable from j in F. 

Lemma 4 implies 

Proposition 3. // i and j belong to different trees in a maximum out forest F of a digraph F 
and j is a root in F, then F contains no paths from i to j. 

After replacing the hypothesis of Lemma 4 with its local version, we can give this lemma the form 
of necessary and sufficient condition: 

Lemma 5. For any maximum out forest F of digraph F and any vertices i,j G V{F), F does 
not contain the arc {i-,j) that belongs to E{F) if and only if F contains an arc {k,j) for some k ^ i 
or i is reachable from j in F. 

4. MAXIMUM OUT FORESTS, BASES, AND UNDOMINATED KNOTS 

u 

Suppose that K = [j Ki, where Ki, . . . ,Ku are all undominated knots of digraph F, and K^' 

1=1 

is the set of all vertices reachable from and unreachable from the other undominated knots. If 
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k E K, then K{k) will designate the undominated knot that contains k. For any undominated knot 
K of r, denote by Fk the restriction of F to K and by F^k the subgraph with vertex set V{F) and 
arc set E{F) \ E[Fk)- For a fixed K, T will designate the set of all spanning diverging trees of Fk 
and V will be the set of all maximum out forests of F^k- By [k G K) we will denote the subset 
of T consisting of all trees that diverge from k, and by p^-*' (i g V{F)) the set of all maximum out 
forests of F^k such that i is reachable from some vertex that belongs to K in these forests. 

Proposition 4. A set W C V{F) is the set of roots of a maximum out forest in F if and only if 
W is a vertex basis of F. 

In view of Proposition 4, the sets of roots of maximum out forests are characterized by Proposi- 
tion 1. The following three statements follow from Propositions 1 and 4. 

Proposition 5. For any maximum out forest F of a digraph F and any undominated knot Ki, 
the restriction of F to is a diverging tree. 

Proposition 6. The forest dimension of a digraph is equal to the number of its undominated 
knots: v = u. 

Proposition 7. The forest dimension of a strong digraph is one. 

To prove Proposition 7, it suffices to observe that the unique undominated knot of a strong digraph 
F is V{F). 

Since every weak component can be split into strong components, at least one of which being 
an undominated knot, the forest dimension of a digraph is nonstrictly between the number of weak 
components and number of strong components. The number of unilateral components is also no 
less than the number of weak components (because every weak component contains at least one 
unilateral component), but it can be less, or greater, or equal to the number of strong components; 
this number can even exceed the number of vertices in F (an example is the bipartite digraph F 
where V{F) = {ii,i2,i3, ji, j2, js} and E{F) = {{ik,jt) \ k,tj= 1, . . . ,3}). Finally, the vertex set of 
any unilateral component either has the empty meet with K or contains exactly one undominated 
knot. That is why the forest dimension of a digraph cannot exceed the number of its unilateral 
components. Thus, the following statement holds true. 

Proposition 8. The forest dimension of a digraph is no less than its number of weak components 
and does not exceed the number of its strong components and the number of its unilateral components. 

Let us fix an arbitrary undominated knot K of F and consider the sets T, V, T^, and p^'^'^ defined 
above. 

Letro-P = {TUF : T G T,F G ;p}, where TUF is a digraph with vertex set V{T)UV{F) = V{F) 
and arc set E{T) U E{F). In the same way, t'^QV^'^' = {T U F : T e T'' , F e V^'^'}- 

Proposition 9. Suppose that K is an arbitrary undominated knot of F and the sets T, V, T-*, 
and 7?^^* (j ^ K, i ^ V{F)) are determined by K. Then 

1. J^ri-v = TQV and £{Tn-v) = e{T)e{V)] 

2. for any j E K and i G V{F), we have 

J^i-r: = T^QV''^' and e{j^i^:) = s{T^)s{v''-'). (1) 
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5. AN ALGORITHMIC DESCRIPTION OF MAXIMUM OUT FORESTS 

In this section, we give a block algorithm for constructing all maximum out forests of F. 

1. Find all undominated knots Ki,. . . ,Ky of F and the sets K^, . . . , . 

2. In every K^, construct an arbitrary spanning diverging tree (rooted within Ki). 

V I 

3. Find the strong components in the restriction of F to V{F) \ U K^. Let Ti,. . . ,Ts be the 

i=l 

sets of vertices of these strong components. 

4. For every Tj, draw one or any greater number of arcs taken from E{F) and directed to distinct 
vertices in Tj. 

5. For every Tj, construct an arbitrary spanning forest rooted at those and only those vertices to 
which the arcs from outside were drawn on step 4. 

6. Consider the spanning subgraph F whose arc set consists of all arcs drawn on steps 2, 4 and 5. 
Step 5 can be reduced to the construction of a tree in the following way. 

5a. Identify all the vertices of Tj to which the arcs from outside were drawn on step 4. Let the 
resulting vertex be Construct an arbitrary diverging tree spanning in the remaining part of Tj 
and rooted at t*. Now split t* into the vertices constituting it and replace the arcs directed from t* 
with arbitrary corresponding arcs directed from these vertices. 

Proposition 10. L The sets of subgraphs determined by steps 5 and 5a of the above block algo- 
rithm coincide. 

2. The set of subgraphs produced by the block algorithm 1-6 coincides with set of maximum out 
forests of F. 

6. PARAMETRIC VERSIONS OF THE MATRIX-FOREST THEOREM 
In [6] we presented a parametric version of the matrix-forest theorem for multigraphs: 

Theorem 1. For any weighted multigraph G with positive weights of edges and any r > 0, there 
exists the matrix Q{t) = {qijir)) = {I + tL(G))~^ and 

n—v n—v 

HA^) = E ^^^^^k)/ E ^""^^k), ij = 1, . . . ,n, 

fe=0 k=0 

where J^k *5 ihe set of all spanning rooted forests of G that contain k edges, J^J^ is the set of all k-edge 
spanning rooted forests of G where j belongs to a tree rooted at i, and v is the number of components 
in G. 

An analogous theorem is true for multidigraphs (that may contain multiple arcs between different 
vertices, but not loops). 

Theorem 1'. For any weighted multidigraph F with positive weights of arcs and any r > 0, there 
exists the matrix Q{t) = {qijir)) = {I + tL{F))~^ and 

n—v n—v 

<lvir) = Y.rHH~^')/T.^'<^k), i,j = l,...,n, (2) 

A;=0 k=Q 

where J^^ and J-'j^^ are defined at the end of Section 2, and v is the forest dimension of F. 

To prove this theorem, it suffices to apply the matrix-forest theorem for multidigraphs [7] to the 
weighted multidigraph F' that differs from F in the weights of arcs only: for all i,j = l,...,n, 

£'■■ = T£- 
13 V 
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The matrix form of this theorem is as follows: 



Theorem 1". For any weighted multidigraph F with positive weights of arcs and any r > 0, there 
exists the matrix Q{t) = (/ + tL{F))~'^ and 

where 

n—v 

s{r) = J2 ^^<^k), Qk = (Qij), qfj = ei^r"), k = 0, . . . ,n - v, i,j = 1, . . . ,n, (3) 
fe=o 

and J^k o,nd J'l^^ are the same as in Fheorem 1'. 

In the case of undirected graphs, the entries of the matrix of maximum rooted forests Qn-v are 
the same within every component of G. In the directed case, the matrix Qn-v possesses nontrivial 
properties determined by the properties of maximum out forests. This matrix is studied in the 
following three sections. 

7. THE MATRIX OF MAXIMUM OUT FORESTS 

According to (3), Qn-v = (Qif''), where q^j'"' = e{j^^'^^), i.e., the element q^j''" of Qn-v is the 
weight of the set of all maximum out forests of digraph F such that i belongs to a tree diverging 
from j. That is why Qn-v can be called the matrix of maximum out forests of F. 

Theorem 2. Suppose that F is an arbitrary digraph and K is an undominated knot in F. Then 
the following statements are true: 

1. For any i G V{F), £ = <^n-v). 

2- qij~" 7^ <^ {j E K and i is reachable from j in F). 

3. Suppose that j G K. Then for any i G V{F), q^-" = e{T^)e{V^-^^). Moreover, if i G K+, then 

4. J2 'fjj'^ = ^{^Fn-v)- In particular, if j is undominated, then q^~^ = e{j^n-v)- 

5. //ji,j2 £ K, then = (e(T"'^)/e(T"'^))(?!!~'', i.e., the ji and j2 columns of Qn-v are propor- 
tional. 

Note that if the forest dimension of F is 1, i.e., F contains a spanning diverging tree, then 
Qn-v = Qn-i and g^~^ = q^~^ for all i,j,k G V{F). Indeed, in this case, q^f^ is a the total weight 
e{T^) of all spanning trees diverging from i. Therefore, by the matrix-tree theorem, Qn-i coincides 
in this case with the matrix of cof actors (the adjugate matrix) of L. 

Definition 3. The matrix J = {Jij) = a^^Qn-v, where a = £{Tn-v), will be called the normal- 
ized matrix of maximum out forests of a digraph. 

The matrix J will be the focus of our attention in what follows. First of all, we reformulate 
Theorem 2 for J. 

Theorem 2'. Suppose that F is an arbitrary digraph and K is an undominated knot in F. 
Then the following statements are true. 

AUTOMATION AND REMOTE CONTROL Vol. 61 No. 9 Part 1 2000 
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1. J is a stochastic matrix: Jij > 0, J2 'hk = 1; i, j = ^, ■ ■ ■ ,n. 

k=l 

2. Jij 7^ 4^ {j K and i is reachable from j in F). 

3. Suppose that j G K. For any i G V{F), J^j = £{T^)e{V^^''')/ ^{J^n-v)- Furthermore, if i G , 
then Jij = Jjj = e{T^)/£{T). 

4- Jjj = 1- -^^ particular, if j is an undominated vertex, then Jjj = 1. 

jeK 

5. //ji,j2 € , then J.j^ = {£{T-'^)/s{T-'^)) J.j^, i.e., the ji and j2 columns of J are proportional. 

Theorem 2' follows from Theorem 2. To prove the last statements of item 3, item 1 of Proposition 9 
can be additionally used. 

Corollary from item 3 of Theorem 2' and Proposition 5. 1. The normalized matrix 
of maximum out forests J = {Jij ) of Fk coincides with the principal suhmatrix of J corresponding 
to K. 

2. If i ^ K'^ and j G K'^ \ K, then J is preserved under any variation of the weight of {i,j)- 

Let K{i) be the undominated knot that includes i, provided that i & K. The following theorem 
is concerned with the comparison of the entries of J. 

Theorem 3. For any F and any i, j G {1, . . . , n}, the following statements are true. 
1 • J a ^ J ji ' 

2. If Jii > J ji, then i ^ K and j ^ K~^{i), therefore, F contains no paths from j to i. 

3. // Jii > Jji > 0, then j ^ K, consequently, j is not the root in any maximum out forest of F. 

4. // Jij > 0, then Ja = Jji . 

Theorem 4. For every weighted digraph, J is idempotent: J = J . 
Recall that L = L{F) = {i^j) is the Kirchhoff matrix of F. 
Theorem 5. For every weighted digraph, L J = J L = 0. 
It is worth noting a certain duality between L and J. 
Proposition 11. The ranks of L and J are n — v and v, respectively. 

Remark. Consider the rows £i, . . . of L as vectors in R". Denote by C the multiset of these 
rows and by Lr the linear span of in R". Since C contains n — v linearly independent 

vectors (Proposition 11), the dimension of Lr \s n — v. 

Let J n be the linear span of the columns of J . By Proposition 11, the dimension of Jr is v. 

Note that: (A) Lr n Jr = {0}. Indeed, if the meet of these two subspaces contained a nonzero 
vector u, then, by Theorem 5, \\u\\'^ = would hold; (B) the dimensions of Lr and Jr sum to n. 

By (A) and (B), R" is decomposable into the direct sum of the subspaces Lr and Jr (see, e.g., [9]): 

R'' = Lr+Jr, 

i.e., every vector G R" can be uniquely represented as n = -ui + n2, where ui G Lr and U2 G J. 
The following theorem provides an explicit expression for J. 
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Theorem 6. For any weighted multidigraph F, 



J = lim {I + tL)~^. 



r— >oo 



(4) 



The stochasticity and idempotence proven for J are typical of the hmiting transition probabihty 
matrices of Markov chains. These matrices also possess some properties that resemble Theorem 5 and 
the other above statements. This resemblance is not accidental. It turns out that J determines the 
asymptotic behavior of certain Markov chains related to F. The corresponding results are presented 
in the following section. 



Definition 4. Let us say that a stationary Markov chain with set of states {1, . . . ,n} and tran- 
sition probability matrix P is related to a weighted digraph F if there exists a such that 



We will identify the states of this Markov chain with the corresponding vertices of F. According to 
Definition 4, if a Markov chain is related to a weighted digraph T, then the probability of transition 

from i to j is proportional to the weight of the (j, i) arc in F. Thus, if the weight of the arc (j, i) 
is interpreted as the degree of preference given to vertex j in a comparison with i or something like 
that, then this weight determines the probability of transition from the dominated vertex to the 
dominating one (the transitions are laid from the "worse" to the "better"). 

It is easy to see that the union of undominated knots of F is the set of essential states (in 
Kolmogorov's notation) of any Markov chain related to F. All other vertices are unessential states 
of every such a chain. 

According to (5), the row defect 1 — aY^^=i £ji determines the probability of transition from i to 
i (a stagnant transition). 

Since we consider finite and stationary Markov chain only, we will omit the words "finite" and 

"stationary." 

Definition 4 differs from the customary way of attaching Markov chains to graphs (used in [10, 
Chapter 9], [11], and many other works). In the Markov chain attached to a graph in accordance 
with the classical definition, the transition probabilities for the pairs of different vertices are not 

generally proportional to the corresponding arc (edge) weights. As a result, the transition probability 
matrices of the Markov chains attached to the graphs with symmetric matrices E and L are generally 
nonsymmetric. 

It is easy to determine the condition under which the matrix (5) represents the transition proba- 
bilities of some Markov chain. 

Proposition 12. Matrix P defined by (5) is the transition probability matrix of a Markov chain 
{and thus this chain is related to F in terms of Definition 4) if and only ifO<a<{ max ^jj"^. 

1< i< n 

Proposition 12 provides a necessary and sufficient condition for the stochasticity of P = I—aL(F); 
it immediately follows from the definition of L. 

Remark. Consider the matrix norm 11 • ||oo on the set of n x n Kirchhoff matrices L: 



8. MARKOV CHAINS RELATED TO A WEIGHTED DIGRAPH 



P = I -aL{F). 



(5) 




n 




This matrix norm is called the maximum row sum norm [12]. 
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The function 11 L |L = max appearing in Proposition 12 is not a matrix norm, since it does 

l<i<n 

not obey submultiplicativity || AB \\ < \\A\\\\B\\. Indeed, to demonstrate this, it is sufficient to take 
for A and B the Kirchhoff matrix of the digraph on two vertices with two symmetric arcs carrying 
unit weights. The other axioms of matrix norms (nonnegativity, positivity, homogeneity, and triangle 
inequahty) are satisfied for || • H^^. Thus, this function is a generalized matrix norm [12]. 

n 

Proposition 13. The matrix ( J2 £kt)~^Qij where Qi is the matrix of diverging forests with one 

k,t=l 

arc {defined in Theorem 1"), is the transition probability matrix of some Markov chain related to F. 

It is easily seen that every Markov chain is related to some weighted digraph. More exactly, there 
is always a family of such digraphs F: their Kirchhoff matrices are 

L(r) = l(7-P) (6) 

with all possible a > 0. The matrices of arc weights of all these digraphs are proportional. 

The sequence P, P^, P^, ... is nonconvergent for periodic Markov chains. Consider the Cesaro 
limit of this sequence, which can be shown to exist for every Markov chain. 

Definition 5. The limiting matrix of average probabilities of a Markov chain is the matrix 
provided that this limit exists. 



Consider also the matrix 

-J m— 1 

3=0 

where m is the period of the Markov chain and Bq, . . . , B^-i are the limiting matrices for the 
convergent subsequences of {-P*}: 

Bj = lim P^'"+J, j = 0,...,m-l. (9) 

i—^oo 

The case m = 1 corresponds to convergent sequences {-P*}. 
The following statement is known. 

Proposition 14. For every Markov chain, there exists the limiting matrix of average probabilities 
B, and B = B' . 

In the Appendix, we give a proof of this proposition which is closely connected with the proof of 
the main result of this section (Theorem 7 below). 

Corollary 1 from Proposition 14. If the sequence {-P*} converges and P°° is its limit, then 
P°° = B. 



Corollary 2 from Proposition 14. For any Markov chain, 

(1) PB = BP = B; 

(2) the nonzero columns of B are right eigenvectors, the rows being left eigenvectors of P, all 
corresponding to eigenvalue 1; 
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(3) for every weighted digraph F to which a Markov chain is related, BL{r) = L{r)B = holds; 

(4) B is idempotent: B^ = B. 



A sort of experiment can be indicated where B{k) and B are the transition probabihty matrices. 
The notion "point in time" means in the following statement the number of transition occurred in a 
Markov chain. 

Proposition 15. 1. Every element bij{k) of B{k) is the probability that the state of the Markov 
chain at a random point in time uniformly distributed on {0,1, ... ,k — 1} is j, provided that the 

initial state is i. 

2. The probability specified in item 1 of this proposition tends to the element bij of B as k ^ oo. 

Item 2 of Proposition 15 refers to experiments where the maximum possible number of Markov 
chain's transitions antecedent to the instant of observation is not bounded a priori; this is a surrogate 
of the impossible uniform distribution on a denumerable set. 

Proposition 16. For every Markov chain, we have 



We are now in position to formulate the main result of this section. 

Theorem 7. For any Markov chain related to a weighted digraph F, the limiting matrix of average 
probabilities B coincides with J . 

Theorem 7 provides a method for a finite (combinatorial) calculation of B (and thus of the station- 
ary distributions of Markov chains and of P°°, provided that the latter matrix exists). This method 
consists in finding and classifying the maximum out forests of a digraph F, i.e., in calculating J. 

The following corollary presents the fact that this method is applicable to every finite Markov 
chain. 

Corollary from Theorem 7. For any Markov chain, the limiting m,atrix of average proba- 
bilities B is equal to the matrix J of any weighted digraph to which this chain is related, i.e., of any 
weighted digraph F that has the Kirchhoff matrix L{F) = a~^{I — P), where a > and P is the 
transition probability matrix of the Markov chain. 

This corollary is deduced from Theorem 7 and Definition 4. 

Remark. By virtue of the above corollary, Theorem 7, and Proposition 14, J can be substituted for 

B and B' in all statements of this section. In this way, items 3 and 4 of Corollary 2 provide Theorem 5 
and Theorem 4, respectively. Thus, the Markov chain technique enables one to get alternative proofs 
of these theorems. 

9. THE WEIGHT OF MAXIMUM OUT FORESTS AS A MEASURE OF VERTEX 

ACCESSIBILITY 

By Theorem 7, the matrix J = (Jij) of a weighted digraph F coincides with the limiting matrix 
of average probabilities of any Markov chain related to F. That is why Jy can be called the limiting 



Let 




(10) 




(11) 
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accessibility of i from j in random walks on F with transition probabilities proportional to the arc 
weights. The matrix will be referred to as the matrix of limiting accessibilities in F. In this section, 
we consider the entries of as a measure of "proximity" between vertices. For this purpose, we 
turn to the conditions proposed in [6, 7] for the description of the notion of vertex proximity. These 
conditions are not considered as necessary attributes of proximity measures, but if some index breaks 
a majority of them, this indicates that the index measures not proximity, but something different. 

Nonnegativity. For any digraph F, p^j > 0, i, j G {1, . . . , n}. 

Reversal property. For any digraph F, the reversal of all its arcs (provided that their weights 
are preserved) results in the transposition of the proximity matrix. 

Diagonal maximality. For any digraph F and any distinct i,j G V{F), p^^ > p^j holds. 

Triangle inequality for proximities. For any digraph F and any i,j,k G V{F), Pij +Pik~Pjk 
< holds. If, in addition, j = k and i 7^ j, then the inequality is strict. 

Let 

dij = Pa +Pjj -Pij -Pji, i,j e{l,...,n}. 

Metric representability of proximity. The index is a distance between the vertices of a 
digraph, i.e., it satisfies the axioms of metrics. 

It has been shown in [13] that the triangle inequality for proximities corresponds to the ordinary 
triangle inequality for the values d^. 

Disconnection condition. For any digraph F and any i,j G y{F), p^j = if and only if j is 
unreachable from i. 

Transit property. For any digraph F and any i,k,t & V{G), if F contains a path from i to k, 
i ^ k ^ t, and every path from i to t includes k, then > p^^ . 

The following condition is formulated here in a weaker version compared to that in [6] . 

Monotonicity. Siippose that the weight of some arc e^^ in a digraph F increases. Then: 

1) ^Pkt > 0' and for any i,j G {1, . . . ,n}, / {k,t) implies Ap,^^ > Ap^y, 

2) for any z G {1, . . . , n}, if there is a path from i to k, and each path from i to t includes k, then 
^Pit > ^Pik ■ 

Suppose that P = (pij) = is the matrix of limiting accessibilities of a digraph. 

Proposition 17. The index of limiting accessibilities of a digraph satisfies nonnegativity and the 
'<^=' part of disconnection condition; diagonal maximality, transit condition, and the first part of item 1 
and item 2 of monotonicity are satisfied in the nonstrict form; reversal property, triangle inequality 
for proximities, metric representability of proximity, the '=^' part of disconnection condition, and the 
second part of item 1 of monotonicity are not satisfied. 

In view of Proposition 17, the index of limiting accessibilities does not completely correspond to the 
concept of proximity lying in the above conditions. This is because it expresses accessibility in infinite 
time. As we are going to show elsewhere, the replacement of J = limT-^oo(-^ + t (Theorem 6) 
by {I + T L)~^ with a finite positive r results in a more sensible index of vertex proximity. 
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10. THE MATRIX OF LIMITING ACCESSIBILITIES AND THE PROBLEM OF 

DETERMINING LEADERS 

Ranking players on the base of tournaments or irregular pairwise contests is an old, but still 
intriguing problem. A statistical version of this problems is estimating objects on the base of paired 
comparisons [14]. Analogous problems of the analysis of individual and collective preferences arise 
in the contexts of voting, expert judgment, sociology, and psychometrics. Hundreds of methods have 
been proposed for the solution of these problems (see, e.g., [14-20]). 

In this paper, we suppose that an incomplete tournament with weighted results of paired contests 
or an incomplete structure of numerical preferences is represented by a weighted digraph F. 

One of the most popular sensitive methods for assigning scores to the participants in a tournament 
was proposed by Daniels in 1969 and reduces, in our notation, to finding nonzero and nonnegative 
solutions to the system of equations 

L^x = 0. (12) 

The entry xi of the solution vector x is used as an evaluation attached to the object represented 

by vertex i. 

The system of equations (12) in a componentwise notation has the form: 

= i = 'i-,---,n. (13) 

In the interpretation by Moon and Pullman [21], Xi is the amount player i pays to any player that 
defeats i. In the simplest case of a nonweighted (but generally incomplete) tournament, the left-hand 
side of (13) is the amount paid by the player for her defeats, whereas the right-hand side is the amount 
collected by the player for her wins. Thus, the equality of these amounts for all participants stated 
by (13) can be considered as a fairness condition^ imposed on the payoff vector x = {xi, . . . ,x„): if 
the strength of each player remains the same, then nobody receives any advantage, and everyone can 
expect a zero total. 

This method was rediscovered several times with different motivations (some references are given 
in [19]). As was noticed by Bcrman [22] (although, in other contexts, this had been remarked by 
Maxwell [23] and other writers), if a tournament is strong, i.e. all its vertices are mutually reachable, 
then the general solution to (12) is given by the vectors proportional to t = (i^^, . . . , i„), where 
is the weight of the set of spanning trees (out arborescences) diverging from i. This fact can be 
easily proved as follows. By the matrix-tree theorem for digraphs (see, e.g., [1]), tj is the cofactor 

n 

of any entry in the jth row of L. Then for every i G V{r), J2 tj = detL (the expansion of the 

determinant by the iih column of L) and, since det L = 0, t is a solution to (12). As rankL = n — 1 
(since the cofactors of L are nonzero), any solution to (12) is proportional to t. 

Berman [22] asserted that this result is sufficient to rank order the vertices in any digraph, because 
its strong components supposedly "can be ranked such that every player in a component of higher rank 
defeats every player in a component of lower rank. Now by ranking the players in each component 
we obtain a ranking of all the players." 

While the statement of the existence of a natural ranking of the strong components is correct 
in the case of round-robin tournaments, it is obviously mistaken for arbitrary digraphs that may 
have, in particular, more than one undominated knot. That is why, the solution obtained for strong 
digraphs provides no means for ranking the vertices of an arbitrary digraph. 

Having in mind this general case (which was not given much attention in the literature) let us 
come back to the system of equations (12). If F contains more than one undominated knot, there 
is no spanning diverging tree in F. On the other hand, it follows from J L = (Theorem 5) that 

^ More exactly, this condition means that the payoff vector is representative of the strength of the players. 
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J =0, that is, every row of J is a solution to (12). Then by Proposition 11, rank J = v and 
rankL = n — v, where v is the forest dimension of F (which is the number of undominated knots 
in r). Consequently, the system (12) has exactly v linearly independent solutions. If j € Ki and 
\Ki\ = k, then by Theorem 2' the jth row of J has the form (0, 0, . . . , 0, , . . . , tj^., 0, . . . , 0). Here 

= e{T^^)/£{T) and the vertices ii,...,ik that belong to are assumed to carry neighboring 
numbers. The multiplier l/e(T) is the same for all the solutions. Dividing by it leads us to the 
solutions with t'^ = e(T**), i.e., t'j^^ is the weight of the set of spanning trees that diverge from ig in 
the undominated knot Ki. This provides a description of v linearly independent solutions to (12). 

Thus, by solving (12) we do not generally obtain a one-dimensional family of evaluation vectors. 
For every undominated knot in F, there is a corresponding partial solution to (12). The general 
solution is provided by all their linear combinations. A reasonable ultimate vector of estimates is the 
convex combination of the rows of J with all weights equal to 1/n (the arithmetic mean of the rows 
of J) . This solution is the probability distribution on the set of digraph vertices implemented in the 
Markov chains related to F, provided that the starting distribution on the set of states is uniform. 

For the example in Section 11, such a solution to (12) is 

X ^ (0; 0; 0.0911; 0.1791; 0; 0.1549; 0.1701; 0; 0; 0.0928; 0.1701; 0; 0.1418)^ . 

In this solution, as well as in all other solutions, the vertices that are outside of all undominated 
knots, are given zero estimates, which is not always reasonable. The estimates based on the matrices 
Q(r) instead of J do not offer this feature. The problem of their analysis looks meaty. 



11. FOREST MATRICES AND THE STRUCTURE OF DIGRAPHS 

V 

As was noted in Section 2, the union K = \J oi undominated knots of a digraph is considered 

i=l 

in the theory of decision making as a natural set of alternatives chosen on the base of a binary relation 
(digraph) of preferences [4]. 

Generally speaking, finding the undominated knots and the vertices reachable from each un- 
dominated knot is the first task in discovering the structure of a digraph. According to item 2 of 
Theorem 2', the calculation of J immediately solves this problem. Indeed, the nonzero columns of 
J correspond to the elements of K, and the row numbers of the nonzero elements of such a nonzero 
column index the vertices reachable from the corresponding undominated knot. In particular, j & K 
and i e K belong to the same undominated knot if and only if Jij ^ 0. 

After the appropriate renumbering of the vertices (giving the first numbers to the vertices in Ki , 
the following numbers to the vertices in K2, and the last numbers to the vertices in V{F) \ K), we 
obtain the matrix j' of the form of 



f 



J'20 



(14) 



where is a square block diagonal matrix whose diagonal blocks consist of strictly positive elements 
and correspond to the undominated knots, and the nonzero elements J^^ of J2 correspond to pairs 

such that i G V{F) \ K and i is reachable from K{j). 
To find the positions of the nonzero elements of J by means of approximate calculations, the 
following statement can be used. 

Proposition 18. Suppose that F is a digraph all whose arcs have the unit weight. Then the 
elements of {I + e^{j^)L{F))~^ that exceed {j^) occupy the same positions as the nonzero elements 
ofJ{F). 

In essence, Proposition 18 is formulated for nonweighted digraphs. This is because the structure 
of a digraph does not depend on the weights of its arcs. 
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Thus, the nonzero elements of J can be found as follows. 

1. Calculate Q{t) = {I + tL)-'^ with r = e^(^). 

2. Replace with zero all the elements of Q{t) less than £~^{j^). The nonzero elements of J occupy 
the complement positions. 

If J is approximately calculated by means of the first item of this algorithm, then the accuracy 
can be estimated by the value of the elements that are replaced with zeros (or by e~^{j^) in the 
absence of such elements). 

The reachability matrix of digraph is the matrix (rj^) with elements 

{1, if j is reachable from 
0, if j is unreachable from i. 

Proposition 19. The reachability matrix can he obtained from the matrix J^{t) with any r > 
by the replacement of all its nonzero elements with 1. The result is independent of the weights of arcs, 
so they can be set equal to 1. 

This proposition follows from Theorem 1'. 

An algebraic way to reveal the strong components of a digraph is to find the equal rows (or 
columns) of the reachability matrix: their equality means that the corresponding vertices belong to 
the same strong component) [2]. A variant of this algorithm is to calculate the mutual reachability 
matrix, which is the Hadamard (componentwise) product of the reachability matrix and its transpose. 

The standard means of finding the reachability matrix of a digraph is calculating (/ + ^)"^^, 
where A is the adjacency matrix, or the successive calculation of the power matrices {I + A)'' until 
the stabilization of the positions of nonzero elements; in both cases, with the replacement of nonzero 
elements in the resulting matrix by ones [2]. 

Example 1. Let us calculate J for the digraph F shown in Fig. 2 and use it to reveal the structure 
of r. 

1 




Figure 2 



The weights of arcs are as follows: e(2, 12) = 1.33; e(8,2) = 1.5; £(13,8) = 0.9; e(ll,8) = 
1.1; e(7, 4) = 0.95; e(7, 5) = 1.3; e(7, 9) = 1.4: e(5, 9) = 1.6; e(6, 9) = 1.25; e(6, 3) = 1.7; £(3, 10) = 
1.67; £(4, 13) = 1.2; e(13, 5) = 1.2; the weights of the remaining arcs are equal to one. 

The result of the approximate calculation of J by means of Theorem 6 is as follows: 
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This matrix is easily represented in the form (14). The first step can be sorting the nonzero 
columns (and thus, classifying the elements of undominated knots) by the positions of nonzero en- 
tries; this reveals two undominated knot: {3, 6, 10} and {4, 7, 11, 13}. On the second step, the rows 
corresponding to the other vertices are classified by the positions of nonzero entries; we conclude 
that the vertices in the strong component {1,5,9} are reachable from the both undominated knots, 
whereas the vertices in the strong component {2, 8, 12} are reachable from the undominated knot 
{4, 7, 11, 13} only. The resulting matrix is 
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Now the digraph F can be represented in a more descriptive form (Fig. 3). 
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Figure 3 



CONCLUSION 



The set of spanning diverging forests of a digraph and the matrix J corresponding to the maximum 
out forests have been analyzed. It has been estabhshed that the matrix J coincides with the matrix 
of Cesaro limiting probabilities of the Markov chains related to the digraph. Therefore, the matrix 
can be considered as the matrix of limiting accessibilities of the digraph. Applications of the 
matrices of diverging forests to the problems of revealing the digraph structure and scoring from 
paired comparisons are discussed. 



Proof of Lemma 2 is given by contradiction. Suppose that for some k G {1, . . . , n — v}, no 
forest F e J^k contains any arc of the form {z,w). Consider an arbitrary F e J^k and any vertex z 
such that {z, w) € E{r). If z is reachable from w in F, then we remove from F any arc of the path 
from w to z (then z becomes unreachable from w) and add the arc {z,w). The resulting digraph 
belongs to J^k- Otherwise, if z is unreachable from w in F, then we remove from F any arc and 
add {z,w). Again the resulting digraph belongs to J^k- 

Proof of Proposition 2. 1. If a vertex is undominated in F, then it is undominated (and thus 
it is a root) in every spanning diverging forest of F. 

2. Assume, on the contrary, that the digraph does not contain circuits, but some dominated vertex 
j is a root in a maximum out forest. Then, adding an arbitrary arc directed to j, we obtain a forest. 
This implies that the previous forest was not maximum. 

Proof of Lemma 3. 1. It follows from item 1 of Proposition 2 that JT^,^* = Fk, therefore, 
^{Tk) = 2. By Lemma 2, J^k contains at least one forest Fk that has an arc directed to w, 

therefore, this forest belongs to J^k\J^'^'^- Since J^^^* = J='k and Sij > for all G E{F), we 
have £(:F^-"*) > £(J^-""'). 

Proof of Lemma 4. Suppose that there is a path from i to j in F, but a maximum out forest 

F docs not contain such paths. Vertices i and j can belong to (a) the same tree in F or (b) different 
trees. In the case (a), either j is the root of this tree, and then i is reachable from j, or the tree 
contains an arc (k,j) with some /c / i, as required. Let us show that in the case (b), j cannot 
be a root in F. This will imply that F contains an arc {k,j) with k ^ i, and the lemma will be 
proved. Assume the contrary and consider an arbitrary path in F from i to j (such a path docs 
exist by the hypothesis of the lemma): (i,ii), (^1,^2), • • • , {is,j)- Let iq = i. By the hypothesis of 
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case (b), io is unreachable from j in F. Let t E {0, . . . , s} be the maximum number such that it is 
unreachable from j in F. By removing in F the arcs directed to i^^i, ■ ■ ■ ,is (the number of these arcs 
is s — t), we obtain a spanning diverging forest where i^+i, . . . ,is,j are roots. By adding s — t + 1 
arcs, {it,it+i), ■ ■ ■ , i}s-,j)-, to this forest, we obtain a digraph with no semicircuits (by the definition 
of t) and with all indegrees not exceeding 1. The obtained spanning diverging forest has more arcs, 
than the maximum out forest F does. This contradiction completes the proof. 

Proof of Lemma 5. Suppose that G E{r) \ E{F). Vertices i and j can belong to (a) 

the same tree in F or (b) different trees. In the case (a), the proof is the same as for Lemma 4. 
Consider the case (b). Since F is maximum, j is not a root in F (otherwise, the addition of (i,j) 
would produce a forest with a greater number of arcs). Consequently, there exists an arc (k,j) from 
some vertex k ^ i to j. 

Conversely, if F contains an arc {k,j) with A; 7^ i or i is reachable from j in F, then is not 

included in F. Indeed, otherwise id(j) > 2 would hold in the first case, and a circuit would occur in 
the second case, but both are impossible in a forest. 

Proof of Proposition 4. Let W be the set of roots of some maximum out forest in F. Then 
all vertices in F are reachable from W by the definition of maximum out forest, and the elements of 
W are mutually unreachable by Proposition 3. Hence, W is a vertex basis of F. 

Conversely, let I^ be a vertex basis of F. Let us demonstrate that W is the set of roots of some 
maximum out forest in F. The following statement is obtained in [8], and we give its proof here for 
the sake of completeness. 

Lemma 6. For any strong digraph F and any vertex j, F contains a spanning tree diverging 
from j. 

Proof of Lemma 6. We construct the desired tree by the sequential addition of arcs. Let Fo 

be the subgraph of F with V{Fo) = {j} and E{Fo) = 0. Suppose that a subgraph F^ is already 
defined and {z,i) is an arbitrary arc in F such that z G V{Fk) and i € V{F) \ V{Fk). Define F^+i 
by setting V{Fk^i) = V{Fk) U {i} and E{Fk+i) = E(Fk) U {{z, i)}. It is obvious that every subgraph 
Fk is a tree diverging from j and that the definition process does not terminate until a spanning tree 
diverging from j is built. Indeed, if the definition process stops at some F^ with k < n — 1, this 
means that F contains no paths from V{Fk) to V{F) \ V^F/.), thus F is not strong. 

To complete the proof of Proposition 4, observe that, by Proposition 1, the set W is made up of 
vertices taken singly from each undominated knot of F. Using Lemma 6, one can construct diverging 
trees rooted at each a such vertex and spanning in their undominated knots. Uniting the arc sets of 
these trees with the set E{F) \ [K x K), where F is an arbitrary maximum out forest in wc obtain 
the arc set of the desired maximum forest. Indeed, the constructed digraph is a diverging forest with 
the set W of roots and its number of arcs is no less than in F. 

Proof of Proposition 5. According to Proposition 4, contains only one root of F. Hence, 
the restriction of F to is a tree diverging from this root, since the vertices in are unreachable 
from the other roots of F. 

Proof of Proposition 9. Let us prove item 2; item 1 is proved similarly. Consider an arbitrary 
forest F G 'pK-^i follows from the definition of undominated knot that all elements of K are 

roots in F. In every tree T T-' , the indegree of every vertex, except the root, is one. Therefore, 
F' = T U F is a spanning diverging forest of F. F' has the maximum possible number of arcs, since 
both T and F are maximum, i.e., F' G J^i^l- Consequently, Q-p^^'^ C T^^^l- Now consider an 
arbitrary forest F' G J^^Z^v- ^7 Proposition 5, the restriction of F' to is a spanning diverging tree 
in K rooted at j. Denote it by . Let us demonstrate that the forest whose arcs are the remaining 
arcs of F' belongs to p^^*. Indeed, i is reachable from K in this forest, and if it is not maximum. 
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then joining the tree with an arbitrary forest of V produces a forest with a greater number of 
arcs than in F' , contradiction. Thus, F' G QP^'^\ therefore, J='l'^^ C T^QV^~^^- Item 2 of 
Proposition 9 is proved. 

Proof of Proposition 10. Item 1 follows from the fact that the identification of all roots 
transforms any diverging forest to a diverging tree, whereas the procedure of root splitting described 
in step 5a produces a forest diverging from the vertices that constitute the root of the tree. 

Item 2. All subgraphs produced by algorithm 1-6 are maximum out forests, since, by construction, 
the indegrccs of all vertices, except for v roots lying in , . . . , , arc equal to 1, and the constructed 
subgraphs contain no circuits, as so does F* . Finally, this algorithm generates all the maximum out 
forests of F, since the restriction of a maximum diverging forest to Kf (i = 1, ...,?;) is a diverging 
tree (Proposition 5), and the restriction to Tj (z = 1, . . . ,s) is a diverging forest whose roots are 
exactly the vertices to which the arcs from outside are directed. 

n n . . 

Proof of Theorem 2. 1. The definition of Qn-v implies q^f" = J2 ^{^i^D- Since 

n 

J^nJ^'ClJ^n^' = whenever ji ^ j2,and IJ = J^n-v, we obtain 

n n 

2. Let q'if^ = ^{Fi^l) 7^ 0. Then i is reachable from j in F and, by Proposition 4, j € K. 
Let us prove the converse statement. Suppose that j € K and i is reachable from j in F. By 
Proposition 4, j is a root in some maximum out forest of F. Denote this forest by F. Suppose that 
i is unreachable from j in F. According to Lemma 4, i cannot be a root in F. Suppose that the 
arcs («i,?2) i---, (isji) make up a path from j to i in F. Remove from E{F) all the arcs 

directed to the vertices ii,. . . ,is, i (the number of them does not exceed s + 1) and add the arcs 
(j, ii), (11,12) , {is, i)- The resulting subgraph F' is also a maximum out forest, and its tree that 
contains i is rooted at j, therefore, q^~'" ^ 0. Item 2 is proved. 

The first statement of item 3 follows from Proposition 9, the second statement from Proposition 5. 

Item 4 is valid, since, by Proposition 4, the sets Fn^y (j G K) make up a partition of Tn-v 

5. By item 3, if ji, j2 £ ^ and i is reachable from then 

If i is not reachable from K, then q^^"" = q^^'" = 0. Thereby, the desired equality and thus Theorem 2 
are proved. 

Proof of Theorem 3. 1. Jjj > J ji, since every vertex i is reachable from itself. 

2. If Jii > Jji, then there exists a maximum out forest F G J^^l where i is a root and j 
is not reachable from i. By Proposition 4, i G if and, by item 3 of Theorem 2', j ^ K~^{i). Vertex i 
is unreachable from j in F, since otherwise j G K{i) by the definition of K{i). 

3. In view of item 2, Ja > Jji implies i & K and j ^ K'^(i). Since Jji > 0, j is reachable from i, 
therefore, j ^ K. Then, by Proposition 4, j cannot be a root in any maximum out forest. 

4. If Jij > 0, then i is reachable from j and, by item 2, Ja > Jji is impossible. Then, by item 1, 

Jii = Jji holds. 

~2 ~i2) 

Proof of Theorem 4. Let J = {J^j )■ For any i,j G V{F), we have 

Jf^ = Y.JikJkj- (15) 
fe=i 
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Consider the case J)7 + 0. 

If Jjj > Jkj 7^ 0, then, by item 3 of Theorem 3, k is not a root in any maximum out forest and 

Jik = 0, hence, Jik Jkj = 0. Since for all k £ V{r), Jjj > Jkj holds (by item 1 of Theorem 3), for 
all nonzero terms in the right-hand side of (15) we have Jkj = Jjj > 0, consequently, 

Jif = hj E Jik, (16) 

keK' 

where K' is the set of vertices k G V{r) such that Jik Jkj 7^ 0- Observe that Jik 7^ and Jkj 7^ 
are true together iff j S i^. A; e and i is reachable from K{j) (see item 2 of Theorem 2'). That 

is why K' = K{j). Using (16) and item 3 of Theorem 2', we obtain 

Suppose now that jf^ = 0. Then, taking k = j \n (15), we conclude that either j ^ K 01 j G K, 
but i is unreachable from K{j). By item 2 of Theorem 2', this implies Jjj = 0. Theorem 4 is proved. 

Proof of Theorem 5. Let us prove the equivalent statement LQ^—v — Qn—v 

L = 0. Let 

n 

S = (sjk) = LQn-v We will show that 5 = 0. By definition, Sjk = ^ji1ik~^ = si + §2, where 

i=l 

Si = J2 ■^jiOik'^ ^^'^ *2 = ^jjOjk^- The number (— si) is equal to the weight of the multiset Q^^ of 

weighted 2-digraphs^ every element^ of which is obtained by the addition of some arc {i, j) G E{r) 
to some forest from J^^Z'^ {i = I, . . . ,n). The result of this addition is generally a 2-digraph, because 
(i, j) can already be in this forest. Q^^ is a multiset, since this representation of such a 2-digraph H 
is not necessarily unique. In this case, ni{H) is the number of different representations. The weight 
of is 

<Q'') = Y.Heg^^ ni{H)e{H). 

Analogously, S2 is the weight of the multiset Q^"^ of weighted 2-digraphs that consists of pairs 
(H, n2{H)), n2{H) > 1, whose elements are obtained by the addition of all possible arcs (i, j) € E{r) 
to all forests from J^n^J ■ We will prove the equality of Q'^^ and Q^^, which will complete the proof of 

J^Qn—v — 0. 

Let us show that H G if and only if i7 G Q^'', and ni{H) = n2{H). 

Suppose that iJ is a weighted digraph and u,w E V{H). By H + {u, w) we denote the 2-digraph 

with vertex set V{H) and the multiset of arcs obtained from E{H) by the increment of the multiplicity 
of {u,w) by 1. Similarly, if iJ is a 2-digTaph and u,w £ V{H), denote hy H' = H — {u,w) the 2- 
digraph differing from H in the multiplicity of arc (u,w) only: n'{{u,w)) = max(n((u, w)) — 1,0). 

Let H e Q^^. By the definition of Q^^, H = F^Z"^ + (i, j), where -F^Z^/ ^ J^n^v some i. Two 
cases are possible: (1) j belongs in F^Z*^ to the tree rooted at k and (2) j does not belong to the 
tree rooted at k. 

In the case (1), F^Z'J € J^^I^J and thus, H = F^z;* + G Q^^. In the case (2), F^^J does not 
contain and i is unreachable fromj. Consequently, by Lemma 5, {t,j) G E{F^Z'y) for some t^i. 
Then we obtain H - {t, j) = (F^z;^ + - {t, j) G Tn-J and hence, H = {H - {t, j)) + {t, j) G Q'^ . 

^ A 2-digraph is here a multidigraph with arc multiplicities not exceeding two. The weight of a 2-digraph is 

the product of the weights of all its arcs (including multiple ones). 

The multiset is a set consisting of pairs (ff, ni(ff)), where is a 2-digraph, n\{H) > 1 being the 
multiplicity of H in Q^^ . If ni{H) > 1, then not only {H,ni{H)), but also H will be called an element of 
Q^'^; in this case, we will use the notation H G Q. 
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Suppose now that H eQ^^. Then H = F^Tj + (ij) for some F^Tj G JT^Z*/ and some i G V{r), 

i ^ j. Let us show that H e Q^^. Two cases are possible: (1) i belongs in Fj^Z*/ to the tree rooted 

at k and (2) i does not belong to the tree rooted at k. In the case (1), F^l^'J € Tn^i and, therefore, 
H E In the case (2), F^^^J does not contain and i is unreachable from j. Consequently, 

by Lemma 5, (t-.j) € E{F^'^,;j) for some vertex t such that t belongs in i^jZ^^ to the tree rooted 
at k. Then H - {t,j) = (F^rj + ihj)) " (tJ) ^ J^ll^^ and hence H = H-{t,j)) + {t,j) € Q'K 

Let us prove now that for every H, ni{H) = n2{H). First, ni{H) and n2{H) do not exceed 2. 
Indeed, by the definitions of Q^^ and Q^'^ , at least three arcs would otherwise be directed to j and 
then H — where is any one of these arcs, would not be a forest. It remains to prove 

that ni{H) = 2 iff n2{H) = 2. Indeed, ni{H) = 2 means that there exist ii,i2 G V{r) such that 

ii ^ i2, E{H) contains (n, j) and (ia, j), H - {hj) G J'n-v^ and ii" - {12, j) G J^^Z;'^ This is 
equivalent (the proof is below) to the fact that there exist distinct ii G V{r) and 12 G F(r') such 
that {12, j)} Z E{H) and {i? — {ii,j),H — {12, j)} Z J-'n'^^ ■> which, in turn, is equivalent to 
n2{H) = 2. To prove the equivalence italicized in the previous sentence, let us formulate the following 
statement, which is tantamount to every side of that equivalence: 

H-{H,j)ej^^-:'; H-{i2,j)ej^^i::\ (17) 

To deduce this from the left member of that equivalence, observe that if, on the contrary, H—{ii,j) ^ 
Tn'^v^ , then (ii, j) belongs in if to a path from k to 12 and thus, 12 is reachable from j in if — (ii,j), 
which contradicts to the presence of {12, j) in H — (?'i,i). Similarly, H — {12, j) G J-n~^'v^- Fiirthcr, (17) 
immediately implies the right-hand member of that equivalence. To deduce (17) from the right-hand 
member of the equivalence, observe that {12,3) is the unique arc directed to j that belongs to the 
forest H — (ii, j), and the reachability of j from k in this forest implies the reachability of 12 from 
k. Consequently, H - (hj) G Tn-v'^- Similarly, H - {12, j) G Tn-v^ ■ Further, H - G Tn-v^ 

implies that 12 is reachable from k in H, therefore, if — (^2, j) G Tn^v^ ■ Similarly, H—{ii,j) G ^^Z^*^. 
Thereby, the left-hand member of the equivalence is deduced from (17). The identity LQn^y = is 
proved. 

The identity Qn-vL = is equivalent to the validity of the following equality for all i,j G 
{l,...,n}: 



^J ^.. = -E^ir4,- (18) 



The left-hand side of (18) is equal to the weight of the multiset of digraphs obtained by the 
addition of all possible arcs (t,j) to all maximum out forests where i belongs to a tree rooted at j. 
Let this multiset be . It is easy to see that has no multiple elements. Indeed, every element of 

is obtained from some forest i^^Z*J by the addition of the arc (t, j); both the i^^Z*J and (t, j) are 
uniquely reconstructed from this digraph. 

The right-hand side of (18) is equal to the weight of the multiset Q"^ of digraphs obtained by the 
addition of all possible arcs (j, k) G E{r) [k 7^ j) to all maximum out forests where i belongs to a 
tree rooted at k. Let us demonstrate that does not contain multiple elements too. Assume, on 
the contrary, that some element H belongs to G with multiplicity greater than one. Then two 
copies of H obtained by the addition of some arcs {j, k{) and {j, /ca) {ki 7^ /ca) to some forests F^^'^ 
and F^^'', respectively, coincide: 

H = + (j, fei) = Ft7' + (j, k2). 

Under this assumption, ki,k2 K and (j, ki), (j, /C2) G E{r), hence, j ^ K and /ci, ^2 G K{j). Then, 
by item 3 of Theorem 2, q^^-^^ = ijki^, therefore, j is reachable from ki in F^^^ . Consequently, 

j is reachable from ki in i^^ZZ** — {ji^i) also, hence, j and ki belong to a circuit in i^^ZZ** = 
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(-F^iV* ~ (j) ^2)) + (j, ^1), which contradicts to the definition of tree. That is why has no multiple 
elements. 

Let us prove the coincidence of and . Let H = F^^^ + {t,j) E Q^. By Lemma 4, t is reachable 
from j in F^^. Consider z & H such that {j,z) is the starting arc of the unique path from j to t 
in H. The removal of (j, z) in H produces a maximum out forest that belongs to T'^^. Indeed, if 
the path from j to i in F^^l contains then the path from z to i is preserved after the removal 
of {j,z). Otherwise, if the path from j to i in F^Z^,^, docs not contain z, then the removal of {j,z) 
preserves this path, and along with the arc {t,j) and the path from z to t, it forms a path from z 
to i in H — {j,z). After the addition of {j,z) to the maximum out forest — {j,z), we obtain a 
digraph that belongs to Q^. 

Let H = -F^Z^* + {j,k) E Q^. By removing from H the last arc, {t,j), of the path from k to j 
(which exists by Lemma 5) we obtain a forest F^^^. The addition of the arc {t,j) to it produces a 
digraph that belongs to Q^. Theorem 5 is proved. 

Proof of Proposition 11. Suppose that the vertex set V{r) is indexed in such a way that the 
first numbers arc given to the vertices in Ki, the following numbers, to the vertices in K2, and so on; 
the last numbers are given to the vertices in R{r). Then both L and J are block lower triangular 
matrices with v + 1 blocks. Every block Lj, i = 1, u, of L coincides with the Kirchhoff matrix of 
the restriction, Fi, of F to Ki. Since Fi is strong, the matrix-tree theorem for digraphs (see, e.g., [1]) 
and Lemma 6 imply that all minors of order {\Ki\ — 1) of Li are strictly positive. Consequently, the 
rank of each ith diagonal block of L is \Ki\ — 1. Let us show that the rank of the last block is equal 
to its order. 

We will use the following notation. Let (p C V{F). Suppose that is the matrix obtained 
from L by deleting the rows and columns corresponding to the vertices in ip; F(^^-j is the multidigraph 
obtained from F by identifying the vertices in ip into the vertex ip*: every arc in F incident to a 
vertex in ip and also to a vertex not in tp induces an arc in P^^) incident to (p* and the same second 
vertex. J^^^ is the set of all spanning diverging forests in F whose roots are exactly the vertices in ip. 
The following statement is due to Fiedler and Sedlacek [8]: 

Lemma 7. For any (p C V{F), detL_^ = e{j^ip). 

Since the weight of is equal to the weight of the set '7(^*) of trees diverging from ip* in F(^^^, 
we have L_<^ = e{T(^*)). 

Let (p = K. Then 7(<^*) 7^ and detL_^ / 0. That is why the rank of the last block of L is equal 
to its order and, finally, rankL = n — v. 

By virtue of item 2 of Theorem 2', the last (its number is {v + 1)) block of J consists of zeros. 
The other blocks are nonzero, and their columns are proportional by item 5 of Theorem 2', i.e., the 
rank of every such a block is 1. Therefore, rank J = v. 

n—v 

Proof of Theorem 6. To prove this fact, it suffices to divide both the numerator ^ t'^ and 

fe=o 

the denominator s(r) of the formula in Theorem 1" by r""^ and to proceed to the limit as r — ^ 00 
using the definition of J. 



Proof of Proposition 13. Suppose that ai = { J2 ^kt) and Pi = (p|) = 

^ k,t=i ' 

= I-aiL{F). Then 

^ k,t=l ' 
' f ^ ^ W ^ N-1 

{ 1^ £kt - 1^ £ki)[ 1^ £kt) , 
_ ^ k,t=l k=l ^ ^ k,t=l ^ 



J =1. 

AUTOMATION AND REMOTE CONTROL Vol. 61 No. 9 Part 1 2000 



1446 AGAEV, CHEBOTAREV 

n 

Thus, p\a coincides with the (i, j)-entry of the matrix ( £kt)~^Qi for every i,j G V{r). Now the 



fe,t=i 



required statement follows from Proposition 12 and the obvious inequality < ( max £jj ^. 



l<i<n 



Proof of Proposition 14. Let \X~\ be the maximum absolute value of the elements of a 
matrix X. Let us take an arbitrary small e > (the designation e has nothing in common with the 

fc-i 



weights of arcs) and find such that 



t=o 



< e for every k > k^. This will prove the 



proposition. 

Choose £ N such that for all i > Iq and j E {0, . . . ,m — 1}, 



pim+j _ p 



< 



Set 



Observe that 



and that for alH G N , 



m— 1 



2(zo+l) 



rn—l 
j=0 j=0 



pt -B' 



< 1. 



(19) 
(20) 
(21) 
(22) 



Suppose that 12 > ii,0 < j2 < m, and A; = m + j2- Then, making use of (19)-(22), we obtain 



fc-i 



i„ m—1 



J2+I 



t=0 



*2 ~1 m—1 



+ 



*2 -'- m—1 



^(Z0+I)m 1 ^ y |p.m+,_o. 

- A; A; ^ I ^ 



zi A; 2 



Proof of Corollary 2 from Proposition 14. Item 1. In view of Proposition 14, 



m—1 



PB = P—Y lim P''"^^' 



j=Q 



-t m—1 -| / / m—1 

- y hm p^^+i+^ = _L y 

m r-r! i-*oo m I I "f— ; 

j=o \ \j=i 



5, 1 + Bo 



B. 



Similarly, BP = B. 

Item 2 of this corollary is just a reformulation of item 1. 
Item 3. By (6) and item 1 of this corollary. 



BUP) = -B(I-P) = -(B-B) = 0. 
a a 



Similarly, L{r) B = 0. 
Item 4. 



1 



m—1 



1 """^ \ 1 

— y lim BP'"'^^ = —mB = B. 
3=0 



B'^ = B\ — y lim P'"'+^ 

TO woo 
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Proof of Proposition 15. Item 1 follows from the formula of total probability; item 2 follows 
from item 1 and Proposition 14. 

Proof of Proposition 16. Since the spectral radius of P is 1, 



Y^{aPf = {I - aP)-' 
t=o 

holds true for every < a < 1. 

Multiplying this identity by (1 — a) and making use of the substitution a = T/(T + l),we obtain 



(23) 



It remains to show that 



1 



lim 

T— >0O J- -j- 



-y(^pY = B 



t=Q 



Applying the reverse substitution t/(t + 1) = a, we shall prove an equivalent (in view of Propo- 
sition 14) statement, namely, 



lim (1 -a)^(aP)* = 5', 

a— >1 , „ 



t=0 



where a ^ 1 designates the convergence to 1 from the left. Given a small e > 0, let us find Oq such 
that for ag < a < 1, 



(1 - a) ^ {aP f - B' 



t=o 



< e 



holds. 

As well as in the proof of Proposition 14, take ig ^ N such that 



<2 



(24) 



for all i > if) and j S {0, . . . ,m — 1}. 
Choose Oq such that < Cq < 1 and 



{l-ao)iom< 



(25) 



Using (21), (22), (24), (25), and the absolute convergence of the series under consideration, for every 
Oq < a < 1 we obtain 



(1 - a) ^ {aPy - B' 
t=o 



(1 - a) ^ {aPy - (1 - a) ^ a'B' 
t=o t=o 

i(, m— 1 oQ m— 1 

= (1 - a) -^') + Yl H a^"^+^(P^"^+^' - B') 

t=0 i=ig j=0 

m—l oo 

< (1 - a)io m + (1 - a) ^ ^ a^"^+^' \P'"'+^ - Bj 

j=0 i=i^ 



< 



e e 



m—l 



= _ + -a*o™ < e. 
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Proof of Theorem 7. The theorem is proved by substituting (5) in (11) and applying Theorem 6 
and Proposition 12. 

Proof of Proposition 17. Nonnegativity and the '<^' part of disconnection condition fohow 
from Theorem 2'; the nonstrict version of diagonal maximality follows from Theorem 3. By item 3 
of Theorem 2', the strict versions of diagonal maximality and transit property are not fulfilled. 

The nonstrict version of transit property is easily proved by contradiction. Assume that for some 
i,k,t G V{G), r contains a path from i to k, i ^ k ^ t, and every path from i to t includes k, 
but p^f > p-j^. Then there exists a maximum out forest F where t is reachable from i, but k is 
unreachable from i, which contradicts to the assumption. The first part of item 1 of monotonicity is 
satisfied in the nonstrict form by the definition of J, but is not satisfied in the strict form by item 2 
of Theorem 2'. By the same reason, the second part of item 1 of monotonicity and the '=^' part of 
disconnection condition are not satisfied. 

Let us prove the fulfillment of item 2 of monotonicity in the nonstrict form. Suppose that the 
weight of some arc {k, t) is increased by Aei^t and the weights of the remaining arcs arc preserved. 
Denote the resuhing digraph by T' and set Q'{t) = {I +TL{r'))-^ . Then AL = L{r')-L{r) = XY , 
where X = {xn) is the column vector with xn = 1 and xn = for all i ^t, and Y = {y\j) is the row 
vector with yik = —Askt, yit = ^^kt, and yij = for all j k, j ^ t. Since the matrices / + TL{r') 
and I + TL{r) are nonsingular and the second one is obtained from the first one by the addition of 
AL with TaxikAL = 1, by [12] we have 

n'M nM rQ{r)XYQ{T) Q{t)XYQ{t) 
^ = ^^^^ - l + rYQir)X = ^^^^ ' \+YQ{r)X- 

Further, Q{t)XYQ{t) = (aijir)), where aij(r) = Aektqit{r){qtj{T) - qkjir)), i,j = l,...,n, and 
YQiT)X = AskMttir) - qktir)). 
We obtain 

/X „ /^^_ ^ektqit{T){qkj{T) - qtj{T)) _ qit{T){qkj{T) - qtj{T)) , . 

- + Aekt{qtt[r) - qkt[r)) + qttij) - qkt[r) 



Let Q^(t) = P(r) = (pijir)). Rewrite (26) for P(r): 

+Ptt{r) -Ptk{r) 



Then for every i G V{r)^ 

{mir) - Ptk{r)){pikir) - Pit{r)) 



^Pitir) - Apikir) 



+ Ptt{r) - ptkir) 



Suppose that there exists a path from i to k and every path from i to t contains k. Then, by the 
matrix-forest theorem, Pikir) > Pit(r) and Pu{t) — Ptkij) > 0- Proceeding to the limit as r — > oo, 
we obtain Apuir) > Z\pjfc(r). 

For every vertex not in K, the corresponding column of J is zero. On the other hand, J has no 
zero rows, since J is stochastic. That is why the reversal property is not satisfied. It is easy tojverify 
that the triangle inequality for proximities is broken for any i,j, k G {1, . . . , n} such that i G K and 
j, k G K~^{i) \ K{i). This implies that metric representability of proximity is not satisfied either. 

Proof of Proposition 18. By Theorem 6, 

J= lim (7 + rL)-\ 

T— >00 
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Let us determine r such that the calculation of (/ + tL)~^ enables one to separate the zero and 
nonzero elements of J. Substituting the notation 

-| n—v—l 1 

A{t) = (aij) = —- Yl r'^Qk, C{T) = ici,) = —-T^-'^Qn-v 

in (2), we obtain 

Q{t)=A{t) + C{t). 

As r ^ oo, we have A{t) 0, Q(r) Qn-v/^iJ^n-v), and C(t) Qn-v/ ^{J^n-v)- 

Let be the set of all spanning diverging forests of F. By Lemma 2 from [7], e{j^) = det(J + L). 
Set 

r = e^iJ^) > 1. 

Then for every aij(T), 

aijir) < ^ = (28) 

holds, whereas for any nonzero element Cij^r), we have 

^n—v 

CiiiT) > = (29) 

Consequently, all the entries of Q(r) that are less than £~^(^), and only such entries, correspond 
to the zero entries of J. 
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